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In t.h o clajnm: 

1. (currently amt?iided) A system jior aiding a porjson with 
vi^^UEil iiiipairmcnt or visual nbsL ruction, comprising! 

mf^ans Tc^r sensing time/apace characl.er;iBtics nnd 
physical charact eristics i nform^ition about a piurrility of 
object.R in a field oT view ot said person; 

means for identi fying, interpret inq , docomposinq, unci 
synLhesizing said tiiuc/spdce characteri stic*? and physical 
characteristics information and for high-level 

characte^ri ^.ing said plurality of objects in an o bieot 
class ; and 

means for verbally commnnicatinq oul.pnt and input 
informs Lion between fjm'd system and ^aid user, 

whoroin said output information fnrLher <jomprises a 
scene description abouL said surrounding environment within 
the fiftld of view of sa.id person^ 

wher ein flnid scene d or^cripLion is ver b.^ l iy commun icated 
in conversa tio ns I. speech to said person based on the 
dis tnnr:e of said pl urality of ob jec ts to s ai d us<=^r, ttie 
clos est being cominun ic ated first as having a h icrhor 
pr i or -f t y , 

wherein said hjco^ne description comprises a hierarch y -e-F 
f^ bioct c -las-s^ said^plura lity of object s identified by said 
system, together wi l.h proper tio F. such as their posiLion 
intormnLion, physical oharac Leristics, and relaLive volocil_y 
vectors indioating motion, a^nd 

where in said properties are provided by a n ObjecL 
Synthesig and Reco gn i tion module which a f^sociates said 
P£op.^ ■" with an identi f i s d object class . 
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2. (rrurrently amended) The syshf^m aocurdi -n-^^Hre of claini i, 
wherein said me<Aiv^ for sensing co^mprises image senRing 
dev. ices seicctfid firom the gronp consiRhing o£: CCD sensors, 
and a 3-1) laser imoginq sensor. 



(currently amended) The system a - ccor d lng t^ ^ pt claim l, 
whorei n Sciid timfi/Rpace charac I. eristic-: and physi^.^ I. 
chciracterist.icB irlf ormat.i on about an objocL includef^ any o£: 
physical dinnnKi.ons , genera I shape deizicri pt ion , texture , 
color, the distance and position of said user from said 
object, mol.iori of said objeci:, spatial relationships beLween 
ob jects . 



4. (currently amended) The syytem ^ee^rdiH iq to of claim 1, 
wherein said means for intdsrpret ing said time/ space and 
physical clitiracteri ?;tics information comprises: a Sensors 
Processor and Control LJnit (SPC) for Intcrprel- i ng low-level 
sensing data from said sensing means, and a High-level 
Vision Processing module for interpreting high-level sensing 
data from said sensing meanR- 



{r:nrrently amended) The system wcordin -g -[ro of claim 1, 
further compriRinq a World Model knowledge database for 
performing said high-level characterizing, 

6. (deleted) 

7. (currently amended) The system accord -ing— bf» of claa.m 5, 
wherein said Wofld Model database is f:ont inuously enriched 
by adapLaLion to new experiences of said person and 
implemented m al. least one option selecl.ed from the modes: 
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cij.recL teciching mod^; 

genera. M Lion tticiching mode by positive enf oroeiT^eiit or 
cJe fault; and 

refinement teac^hrng mode by negative enforcement or 
<jor recti on , 

8-9* (dcilotGd) 

10. (ciirronLly diiiendcod) An appciratus for aiding a visually 
.impaired or blind per^jon to detect and ide^nbify -^^^ a 
plurality of objects in hia field of vision, comprisinq; 

at loai^L one <jomputor i ^;t=id imaging device £tjL- deLeot iiig 
ond identifying said plurality o:f objeeta; 

a "Procesying and Control Unit for receiving and 
processing i n roriiiation from said at leap,t one computer.! 7;ed 
imqaging device and said person; and 

a user interfdce Module for receivinq inatructions Trom 
said Processing cind Control Unit for the purpose of ve^rba I Ly 
describing to said person said plurality of objeots in said 
field of vision, thereby enabling said person to cope with 
and prooeed in the surroundings, 

11-25- (deleted) 

2fj. (currently amended) Thti apparatus aooording lio of claim 
10, further comprlsinq an ciutomatic speech reeognition uniL 
for verbal input of insLructions from said person to said 
Prooopisi ng and Control Unit- 

27. (currently amcnde^d) compute r program product 

c omprir. ing a computer us able modinm having coiupute r readable 
cc>d^: (:MTib odicd therein for ex i-ic i j t low on a gen er al purpose 
eom put e r, said cnmpnl.er usabl e me dium storing i nstruc t ion s 
i.hat, when exec uted by the computer, caus e th e computer to 
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perform [A] a method for dcjtet:t.T ng, aiicilyziny, ident.i fy lug, 
and xcporhing ^ plurality of objoGl.s by name Lo a vlr.Lially 
Inipalred or blind person in n field of view of r-aid person, 
compr ifji nq the stops o£: 

providing a 3^D laser imaging systom Lo ciccurately 
measure both l.he coordinai.Rs of said plijr:ality of objtJctK in 
both fsl.atic cind dynrimic motion and the oharacterizntion of 
I. he relationships between said plurality of objects in 
relation to said person; 

acquiring a plurality of 3-D visn.il imagof^ and information 

c-^bout said plurality of objects; 

procoasing said plurality of 3-D visual imdges and 

said -in roriiiation; 

storing said information of said plurality o£ objeots 

by names in a hierarchy utifizinq a strnotLired World Model; 
idenLifying said plurality or objects, and 
communicating verbally with said person to report said 

information abouL said pluraiiLy of objects in said Meld of 

viow^ 

reflecting and capl.nring laser pulses from the surfacor, 
of said plurality of objectr? present in close rang« to said 
person Lo produce a "cloud" of spatial pixels (voxels) 
reprenting poinLs on all said surfaces which can b^* observed 
from said person's point of view; 

applying a set of low-level algorithms to decompose 
said "cloud" inLo a set of regular surfaces defined by 
paromeLers of type, dimensions, orientation in space, and 
relative {to said us<=!r) velocity vector; and 

applying a set of high-level algorithms to acl. on said 
surlacea to ooinbine thom into identified 3-D objects with 
assigned names , 
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2 0-30 . (dn h^Led) 

31. (currently am^^nded) The method t vccor ding— of claiin 27 
furt.her comprising 3^D object rendering. 

32-34. (delet.f^^d) 

35, (currc^nl.ly amended) Th^ method s - voGor di-i ig to of claim 21, 
fnrlher comprif.lng communicating Lhe verbal description ol 
thR Kcene related to Raid plurality ol objects in ^^aid field 
of vision i.o said person. 

3r>. (currently cimcnded) A system for nidlng ^ person with a 
visual impm'rmeiit or visual obstruction, comprising: 

means for sensing timc/^spfice characrtcrisLics and 
physical character i f^tics information about the physical 
environment in a Held of view of said person ; 

means for identifying, in l.Ffrpreting, decomposing, and 
f=iyni:..,hesizing p,aid time/space charaol^^ristica and physical 
charact^^ristics intormation cind Tor high-lRvel 

characterizing said physical c=jnvi ronmerit ; and 

Kieans for verbally coimnunicat i ng a scyrie dr^r.rjripLion 
dr-Mie.ri h -i-ng which d^sc riboR to said user the characLeriificition 
o£ and y^iid interpreLatioii about, said phyi^ical environment, 

37. (currently cimendcd) The system T i - ccordiii g of clciim 36, 
wherein said means for sensing comprises image sensing 
devices selectc^d from Lhe qroup consisting of; CCD sensors, 
and a 3-D laser imaging sensor* 
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38- (currently am.^nded) The r.ysLem ae^r ding Lo of cMLm 5, 
wherein j^aid World Model Uatcibasa comprises data SjeiccLed 
Iroiii the group of: 

phyLiicQ], descriptions of known objects and componont.R 
l.heceof ; 

the relations of s^iid objects to t.hoir respective said 
corriponents ; 

common relationfihips among Hiiid componenta; 

gro\ipinqs of seiLd known objecLs into classes ciind 
SUbclcLSseR ; 

common properties of said cliiiLisea, subclassG;i5 and 
groupinf-^s; cind 

common relations cimong and between Sdid claBRor;, 
subclasses cind groupings. 

39. (rnrronLly amended) The systom as — hft o£_ olaim 7 
wherein said direcL Leaching mode comprises giving a name to 
a prirt of a sceno by said user, 

40- {currently cimended) The i^ystem as-^H^ of claim 7 wherein 
said gcn(=ira li ^'.ation teaching mode comprinns identifying a 
Pfirt of a givnn ?=;cene as belonging i_o a specific objecL 
clasK , although some of the relationships, or some of tho 
componentij, may devid.te from thai. identified in said 
d fit abase * 

41, (currently amendfid) The system in of claim 7 whnrcin 
said refinement tfoaching mode comprises refining the set of 
definitions to permanently exclude in the future an 
identification of only part of a scene as bo longing to ix 
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iBpeciTic object clnss when said user has rejected snid 
par l.i n I identlf icdtion * 

42. (currently cimended ) Tho apporatus au-uording -^^ o£ claim 
iO wherein said User Iriterfacn Module re^jeives verbal 
in^Lructions from Raid person in a direct teaching niodc to 
■improve said World Model knowledge datcibase capabilities for 
naming and cla.sai Tying a plurality of objects within said 
field of view. 

43. (currently amended) The system r K^oording t o oT claim 1, 
whorcin said means for .i.ntnrpiretaLion comprisGs F;ct5^ne 
interpretation d/ita and sensed datci ^streams. 

44. (currently nmended ) The system acoor -ding— of claim 1, 
wherein s^iid means for inl.Rrpretatiun further comprijHeR 
compn l.nLi ons :Cor reletting distanc^os and color information of 
said plurality of objecLs and con^poiients thereof within the 
field of vision of said pRrson- 

45- (currently amended) The system according to of claim 1, 
wherein said output information comprises sciid 
characterisation and inl.erpretation of said plurality of 
objects . 

46- 49 . (deleted) 
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50, (currently amended) The apparatus et g - eurdin -g— of claim 
26, wherein said instructions c^jomprise naming and 
classifying objects? known to Raid Liaer. 

1)1 . (de l eted) 

r)2- (currently amended) The method of claim 27 yet- further 
comprising : 

providing n process of learning new fiicts aboot said 
physical surronnd-i ngs or said person for qrowth nnd 
expnnsion of said World Modal. 

53. (previously presen Led ) The method of claim 27 wherein 
said World Model hierarchically represent.B existing 
knowledge of the physical surroundings of said poraon; 
classes or said pluraJit.y of objects; the common 
roliitionships of said plurality of objects to their 
components: and the wny low-level components in said 
hierarchy can be composed of rngnlor surfaces • 
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